Using smart groups for computer-based security awareness training systems

ABSTRACT

This disclosure describes embodiments of an improvement to the static group solution because all the administrator needs to do is specify the criteria they care about. Unlike static groups, where the administrator needs to keep track of the status of individual users and move them between static groups as their status changes, smart groups allows for automatic identification of the relevant users at the moment that action needs to be taken. This feature automates user management for the purposes of enrollment in either phishing and training campaigns. Because the smart group membership is determined as the group is about to be used for something, the smart group membership is always accurate and never outdated. The query that determines the smart group membership gets run at the time when you are about to do a campaign or perform some other action that needs to know the membership of the smart group.

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application is a continuation of, and claims priority to andthe benefit of U.S. patent application Ser. No. 17/074,079, filed Apr.Oct. 19, 2020, and titled “USING SMART GROUPS FOR COMPUTER-BASEDSECURITY AWARENESS TRAINING SYSTEMS,” which is a continuation of andclaims priority to and the benefit of U.S. patent application Ser. No.16/750,580, filed Apr. Jan. 23, 2020, and titled “USING SMART GROUPS FORCOMPUTER-BASED SECURITY AWARENESS TRAINING SYSTEMS,” which is acontinuation of and claims priority to and the benefit of U.S. patentapplication Ser. No. 15/958,644, filed Apr. 20, 2018, and titled “USINGSMART GROUPS FOR COMPUTER-BASED SECURITY AWARENESS TRAINING SYSTEMS,”which claims priority to and the benefit of U.S. Provisional PatentApplication No. 62/488,474, filed Apr. 21, 2017, and titled “USING SMARTGROUPS FOR SIMULATED PHISHING TRAINING AND PHISHING CAMPAIGNS,” all ofwhich are incorporated herein by reference.

FIELD OF THE DISCLOSURE

This disclosure generally relates to systems and methods for using smartuser groups, also known as dynamic groups, in computer-based securityawareness training systems.

BACKGROUND OF THE DISCLOSURE

As part of a computer-based security awareness training system, it canbe useful to perform simulated phishing attacks on a user or a set ofusers. A phishing attack involves an attempt to acquire sensitiveinformation such as usernames, passwords, credit card details, etc.,often for malicious reasons, possibly by masquerading as a trustworthyentity. For example, an email may be sent to a target, the email havingan attachment that performs malicious actions when executed orcontaining a link to a webpage that either performs malicious actionswhen accessed or prompts the user to execute a malicious program.Malicious actions may be malicious data collection or actions harmful tothe normal functioning of a device on which the email was activated, orany other malicious actions capable of being performed by a program or aset of programs. Using simulated phishing attacks as part of acomputer-based security awareness training system allow an organizationto determine the level of vulnerability to phishing attacks of a user orset of users. This knowledge can be used by organizations to reduce thislevel of vulnerability through tools or training.

BRIEF SUMMARY OF THE DISCLOSURE

Dynamic groups are being used for purposes of reporting. For example,when an administrator searches for users that meet criteria with Booleanlogic (e.g., in crystal reports with query), a report can be generatedand saved. Every time the administrator runs a report, data is generatedbased on query.

Conceptually, similar types of dynamic groups have been used in anactive directory that uses groups for distribution lists (e.g., dynamicdistribution groups as used in IT environment). Dynamic group systemsmay be used in a manual method for security groups and in scripts thatrun on a regular basis for managing group membership. These types ofgroups have been used in things like reporting where you can createcriteria of what you are going to include in a report.

In some cases, a campaign management system, for example acomputer-based security awareness training system capable of runningsimulated attack campaigns, may only use static groups. Static groupsare either manually managed or they are managed through some kind of aworkflow process. For example, users that meet a criterion may bemanually added into a static group and can only be taken out of thestatic group by a workflow process or by a manual action.

Some problems with static groups include workflow inefficiencies andworkflow inaccuracies resulting from the use of static groups to formdifferent user groups based on different criteria. For example,scenarios where company administrators try to take users out of onestatic group and put them into another static group resulted in manypermutations of users that have been trained, have been phished, havefailed a phishing test, have done remediation training, etc. Workflowdriven user group membership can result in a very large number ofspecific logic branches that need rules to handle them. This can beespecially cumbersome to an administrator that will easily lose track ofthese rules. It is realized that you could have an infinite number ofstatic groups that are being driven by workflows and manual actions. Ifa workflow process isn't being handled accurately, users will getmissed. Because static groups are driven by user workflows and anadministrator, mistakes can and do happen. This results in a relativelylarge number of groups and administrators needing to correctly put usersinto the static groups at the outset.

Smart groups (which may also be referred to as dynamic groups) of thepresent disclosure provide a solution to these problems and limitationsby accurately and automatically building a list of users that meetspecified criteria at the moment that the list of users is requested orused. Smart groups are essentially query based groups.

This present solution expands on similar concepts in reporting where youcan now create a group which contains users where those users meetcertain criteria, and then produce a report based on the list of users.Smart groups enable similar dynamic creation of groups for purposesother than reporting, for example for training and phishing campaigns.

This solution is an improvement to the static group solution because allthe administrator needs to do is specify the criteria they care about.Unlike static groups, where the administrator needs to keep track of thestatus of individual users and move them between static groups as theirstatus changes, smart groups allows for automatic identification of therelevant users at the moment that an action needs to be taken. Thisfeature automates user management for the purposes of enrollment ineither phishing and training campaigns.

Because the smart group membership is determined as the group is aboutto be used for something, the smart group membership is always accurateand never outdated. The query that determines the smart group membershipgets run at the time when you are about to do a campaign or perform someother action that needs to know the membership of the smart group. Thesmart group is always going to be based on whatever criteria anadministrator specified when the group was created. By basing a smartgroup's membership on criteria and only adding users that meet thecriteria at the moment when the group is used, the system ensures thatgroup membership is accurate and up to date and that the users on whichan action is performed (e.g. training campaign, simulated phishingcampaign, report, etc.) are the correct users at the time the action isperformed.

In an implementation, a server may establish a group based on criteriathat are used to identify users, at the time when the group is going tobe used. The server may receive an indication that the group membershipis needed, and upon receiving the indication the server may query apopulation of users to determine which users meet the criteriaassociated with the group, and identifying those users as members of thegroup. In an implementation, the server establishes the criteria for thegroup, and in other implementations the server receives the criteria forthe group. In some implementations, one or more criteria may be combinedby logical operators to form a group criteria.

In an implementation, the server may receive a request to execute asimulated phishing campaign for a group, and this request is theindication to the server that the group membership is to be identifiedthrough a query using the group criteria. In other implementations, theserver may receive a request for membership of the group, or a requestfor a report related to the group, and these requests are the indicationto the server that the group membership is to be identified through aquery using the group criteria.

In an implementation, the server may address to query to a databasecontaining information about the users that is located on a differentserver or device or in the cloud.

In an implementation, the server may receive an additional indication touser the group and may perform a new query to a population of users todetermine which users meet the criteria associated with the group, andthe new population of users of the group are different from thepopulation of users that were identified as part of the group on theprevious query.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and other objects, aspects, features, and advantages ofthe disclosure will become more apparent and better understood byreferring to the following description taken in conjunction with theaccompanying drawings, in which:

FIG. 1A is a block diagram depicting an embodiment of a networkenvironment comprising a client device in communication with a serverdevice;

FIG. 1B is a block diagram depicting a cloud computing environmentcomprising a client device in communication with cloud serviceproviders;

FIGS. 1C and 1D are block diagrams depicting embodiments of computingdevices useful in connection with the methods and systems describedherein.

FIG. 2A depicts some of the architecture of an implementation of asystem configured to automatically add users to user groups responsiveto a user interacting with simulated phishing emails and responsive to auser completing electronically tracked remediation training.

FIG. 2B depicts some of the architecture of an implementation of asystem configured to dynamically create user groups responsive to arequest and according to established criteria.

FIG. 3A depicts an implementation of a method for adding users to usergroups responsive to a user interacting with simulated phishing emailsand responsive to a user completing electronically tracked remediationtraining.

FIG. 3B depicts an embodiment of the method whereby the system tracksthe number times the user of a first user group has interacted withsimulated phishing emails and adds the user to a second user groupresponsive to this number reaching a predetermined threshold.

FIG. 3C depicts an embodiment of the method whereby the system tracksthe number of courses of electronically tracked remediation training theuser, who is a member of the second user group, has completed and addsthe user to a predetermined user group corresponding to one or morecourses of the number of courses the user has completed.

FIG. 3D depicts an embodiment of the method whereby the system addsusers of a first user group to a second user group responsive toreceiving an indication that a user has interacted with a simulatedphishing email, and keeping the user in the second user group whileadding the user back to the first user group (for embodiments where theuser was removed from the first user group) or to a third user groupresponsive to receiving an indication that the user completedremediation training.

FIG. 4 depicts an embodiment of the method whereby the system receives aselection of at least one criteria for which to create a smart group,establishes a group comprising the at least one criteria, receives arequest to identify members of the group and identifies members of thegroup by performing a query of the plurality of users using theestablished criteria.

DETAILED DESCRIPTION

For purposes of reading the description of the various embodimentsbelow, the following descriptions of the sections of the specificationand their respective contents may be helpful:

Section A describes a network environment and computing environmentwhich may be useful for practicing embodiments described herein.

Section B describes embodiments of systems and methods for adding usersto user groups and systems and methods for using smart groups.

A. Computing and Network Environment

Prior to discussing specific embodiments of the present solution, it maybe helpful to describe aspects of the operating environment as well asassociated system components (e.g., hardware elements) in connectionwith the methods and systems described herein. Referring to FIG. 1A, anembodiment of a network environment is depicted. In brief overview, thenetwork environment includes one or more clients 102 a-102 n (alsogenerally referred to as local machine(s) 102, client(s) 102, clientnode(s) 102, client machine(s) 102, client computer(s) 102, clientdevice(s) 102, endpoint(s) 102, or endpoint node(s) 102) incommunication with one or more servers 106 a-106 n (also generallyreferred to as server(s) 106, node 106, or remote machine(s) 106) viaone or more networks 104. In some embodiments, a client 102 has thecapacity to function as both a client node seeking access to resourcesprovided by a server and as a server providing access to hostedresources for other clients 102 a-102 n.

Although FIG. 1A shows a network 104 between the clients 102 and theservers 106, the clients 102 and the servers 106 may be on the samenetwork 104. In some embodiments, there are multiple networks 104between the clients 102 and the servers 106. In one of theseembodiments, a network 104′ (not shown) may be a private network and anetwork 104 may be a public network. In another of these embodiments, anetwork 104 may be a private network and a network 104′ a publicnetwork. In still another of these embodiments, networks 104 and 104′may both be private networks.

The network 104 may be connected via wired or wireless links. Wiredlinks may include Digital Subscriber Line (DSL), coaxial cable lines, oroptical fiber lines. The wireless links may include BLUETOOTH, Wi-Fi,Worldwide Interoperability for Microwave Access (WiMAX), an infraredchannel or satellite band. The wireless links may also include anycellular network standards used to communicate among mobile devices,including standards that qualify as 1G, 2G, 3G, or 4G. The networkstandards may qualify as one or more generation of mobiletelecommunication standards by fulfilling a specification or standardssuch as the specifications maintained by International TelecommunicationUnion. The 3G standards, for example, may correspond to theInternational Mobile Telecommunications-2000 (IMT-2000) specification,and the 4G standards may correspond to the International MobileTelecommunications Advanced (IMT-Advanced) specification. Examples ofcellular network standards include AMPS, GSM, GPRS, UMTS, LTE, LTEAdvanced, Mobile WiMAX, and WiMAX-Advanced. Cellular network standardsmay use various channel access methods e.g. FDMA, TDMA, CDMA, or SDMA.In some embodiments, different types of data may be transmitted viadifferent links and standards. In other embodiments, the same types ofdata may be transmitted via different links and standards.

The network 104 may be any type and/or form of network. The geographicalscope of the network 104 may vary widely and the network 104 can be abody area network (BAN), a personal area network (PAN), a local-areanetwork (LAN), e.g. Intranet, a metropolitan area network (MAN), a widearea network (WAN), or the Internet. The topology of the network 104 maybe of any form and may include, e.g., any of the following:point-to-point, bus, star, ring, mesh, or tree. The network 104 may bean overlay network which is virtual and sits on top of one or morelayers of other networks 104′. The network 104 may be of any suchnetwork topology as known to those ordinarily skilled in the art capableof supporting the operations described herein. The network 104 mayutilize different techniques and layers or stacks of protocols,including, e.g., the Ethernet protocol, the internet protocol suite(TCP/IP), the ATM (Asynchronous Transfer Mode) technique, the SONET(Synchronous Optical Networking) protocol, or the SDH (SynchronousDigital Hierarchy) protocol. The TCP/IP internet protocol suite mayinclude application layer, transport layer, internet layer (including,e.g., IPv6), or the link layer. The network 104 may be a type of abroadcast network, a telecommunications network, a data communicationnetwork, or a computer network.

In some embodiments, the system may include multiple, logically-groupedservers 106. In one of these embodiments, the logical group of serversmay be referred to as a server farm 38 (not shown) or a machine farm 38.In another of these embodiments, the servers 106 may be geographicallydispersed. In other embodiments, a machine farm 38 may be administeredas a single entity. In still other embodiments, the machine farm 38includes a plurality of machine farms 38. The servers 106 within eachmachine farm 38 can be heterogeneous—one or more of the servers 106 ormachines 106 can operate according to one type of operating systemplatform (e.g., WINDOWS NT, manufactured by Microsoft Corp. of Redmond,Wash.), while one or more of the other servers 106 can operate onaccording to another type of operating system platform (e.g., Unix,Linux, or Mac OS X).

In one embodiment, servers 106 in the machine farm 38 may be stored inhigh-density rack systems, along with associated storage systems, andlocated in an enterprise data center. In this embodiment, consolidatingthe servers 106 in this way may improve system manageability, datasecurity, the physical security of the system, and system performance bylocating servers 106 and high-performance storage systems on localizedhigh-performance networks. Centralizing the servers 106 and storagesystems and coupling them with advanced system management tools allowsmore efficient use of server resources.

The servers 106 of each machine farm 38 do not need to be physicallyproximate to another server 106 in the same machine farm 38. Thus, thegroup of servers 106 logically grouped as a machine farm 38 may beinterconnected using a wide-area network (WAN) connection or ametropolitan-area network (MAN) connection. For example, a machine farm38 may include servers 106 physically located in different continents ordifferent regions of a continent, country, state, city, campus, or room.Data transmission speeds between servers 106 in the machine farm 38 canbe increased if the servers 106 are connected using a local-area network(LAN) connection or some form of direct connection. Additionally, aheterogeneous machine farm 38 may include one or more servers 106operating according to a type of operating system, while one or moreother servers 106 execute one or more types of hypervisors rather thanoperating systems. In these embodiments, hypervisors may be used toemulate virtual hardware, partition physical hardware, virtualizephysical hardware, and execute virtual machines that provide access tocomputing environments, allowing multiple operating systems to runconcurrently on a host computer. Native hypervisors may run directly onthe host computer. Hypervisors may include VMware ESX/ESXi, manufacturedby VMWare, Inc., of Palo Alto, Calif.; the Xen hypervisor, an opensource product whose development is overseen by Citrix Systems, Inc.;the HYPER-V hypervisors provided by Microsoft or others. Hostedhypervisors may run within an operating system on a second softwarelevel. Examples of hosted hypervisors may include VMware Workstation andVIRTUALBOX.

Management of the machine farm 38 may be de-centralized. For example,one or more servers 106 may comprise components, subsystems and modulesto support one or more management services for the machine farm 38. Inone of these embodiments, one or more servers 106 provide functionalityfor management of dynamic data, including techniques for handlingfailover, data replication, and increasing the robustness of the machinefarm 38. Each server 106 may communicate with a persistent store and, insome embodiments, with a dynamic store.

Server 106 may be a file server, application server, web server, proxyserver, appliance, network appliance, gateway, gateway server,virtualization server, deployment server, SSL VPN server, or firewall.In one embodiment, the server 106 may be referred to as a remote machineor a node. In another embodiment, a plurality of nodes 290 may be in thepath between any two communicating servers.

Referring to FIG. 1B, a cloud computing environment is depicted. A cloudcomputing environment may provide client 102 with one or more resourcesprovided by a network environment. The cloud computing environment mayinclude one or more clients 102 a-102 n, in communication with the cloud108 over one or more networks 104. Clients 102 may include, e.g., thickclients, thin clients, and zero clients. A thick client may provide atleast some functionality even when disconnected from the cloud 108 orservers 106. A thin client or a zero client may depend on the connectionto the cloud 108 or server 106 to provide functionality. A zero clientmay depend on the cloud 108 or other networks 104 or servers 106 toretrieve operating system data for the client device. The cloud 108 mayinclude back end platforms, e.g., servers 106, storage, server farms ordata centers.

The cloud 108 may be public, private, or hybrid. Public clouds mayinclude public servers 106 that are maintained by third parties to theclients 102 or the owners of the clients. The servers 106 may be locatedoff-site in remote geographical locations as disclosed above orotherwise. Public clouds may be connected to the servers 106 over apublic network. Private clouds may include private servers 106 that arephysically maintained by clients 102 or owners of clients. Privateclouds may be connected to the servers 106 over a private network 104.Hybrid clouds 108 may include both the private and public networks 104and servers 106.

The cloud 108 may also include a cloud-based delivery, e.g. Software asa Service (SaaS) 110, Platform as a Service (PaaS) 112, andInfrastructure as a Service (IaaS) 114. IaaS may refer to a user rentingthe use of infrastructure resources that are needed during a specifiedtime period. IaaS providers may offer storage, networking, servers orvirtualization resources from large pools, allowing the users to quicklyscale up by accessing more resources as needed. Examples of IaaS includeAMAZON WEB SERVICES provided by Amazon.com, Inc., of Seattle, Wash.,RACKSPACE CLOUD provided by Rackspace US, Inc., of San Antonio, Texas,Google Compute Engine provided by Google Inc. of Mountain View, Calif.,or RIGHTSCALE provided by RightScale, Inc., of Santa Barbara, Calif.PaaS providers may offer functionality provided by IaaS, including,e.g., storage, networking, servers or virtualization, as well asadditional resources such as, e.g., the operating system, middleware, orruntime resources. Examples of PaaS include WINDOWS AZURE provided byMicrosoft Corporation of Redmond, Wash., Google App Engine provided byGoogle Inc., and HEROKU provided by Heroku, Inc. of San Francisco,Calif. SaaS providers may offer the resources that PaaS provides,including storage, networking, servers, virtualization, operatingsystem, middleware, or runtime resources. In some embodiments, SaaSproviders may offer additional resources including, e.g., data andapplication resources. Examples of SaaS include GOOGLE APPS provided byGoogle Inc., SALESFORCE provided by Salesforce.com Inc. of SanFrancisco, Calif., or OFFICE 365 provided by Microsoft Corporation.Examples of SaaS may also include data storage providers, e.g. DROPBOXprovided by Dropbox, Inc. of San Francisco, Calif., Microsoft SKYDRIVEprovided by Microsoft Corporation, Google Drive provided by Google Inc.,or Apple ICLOUD provided by Apple Inc. of Cupertino, Calif.

Clients 102 may access IaaS resources with one or more IaaS standards,including, e.g., Amazon Elastic Compute Cloud (EC2), Open CloudComputing Interface (OCCI), Cloud Infrastructure Management Interface(CIMI), or OpenStack standards. Some IaaS standards may allow clientsaccess to resources over HTTP and may use Representational StateTransfer (REST) protocol or Simple Object Access Protocol (SOAP).Clients 102 may access PaaS resources with different PaaS interfaces.Some PaaS interfaces use HTTP packages, standard Java APIs, JavaMailAPI, Java Data Objects (JDO), Java Persistence API (JPA), Python APIs,web integration APIs for different programming languages including,e.g., Rack for Ruby, WSGI for Python, or PSGI for Perl, or other APIsthat may be built on REST, HTTP, XML, or other protocols. Clients 102may access SaaS resources through the use of web-based user interfaces,provided by a web browser (e.g. GOOGLE CHROME, Microsoft INTERNETEXPLORER, or Mozilla Firefox provided by Mozilla Foundation of MountainView, Calif.). Clients 102 may also access SaaS resources throughsmartphone or tablet applications, including, e.g., Salesforce SalesCloud, or Google Drive app. Clients 102 may also access SaaS resourcesthrough the client operating system, including, e.g., Windows filesystem for DROPBOX.

In some embodiments, access to IaaS, PaaS, or SaaS resources may beauthenticated. For example, a server or authentication server mayauthenticate a user via security certificates, HTTPS, or API keys. APIkeys may include various encryption standards such as, e.g., AdvancedEncryption Standard (AES). Data resources may be sent over TransportLayer Security (TLS) or Secure Sockets Layer (SSL).

The client 102 and server 106 may be deployed as and/or executed on anytype and form of computing device, e.g. a computer, network device orappliance capable of communicating on any type and form of network andperforming the operations described herein. FIGS. 1C and 1D depict blockdiagrams of a computing device 100 useful for practicing an embodimentof the client 102 or a server 106. As shown in FIGS. 1C and 1D, eachcomputing device 100 includes a central processing unit 121, and a mainmemory unit 122. As shown in FIG. 1C, a computing device 100 may includea storage device 128, an installation device 116, a network interface118, an I/O controller 123, display devices 124 a-124 n, a keyboard 126and a pointing device 127, e.g. a mouse. The storage device 128 mayinclude, without limitation, an operating system, software, and asoftware of a simulated phishing attach system 120. As shown in FIG. 1D,each computing device 100 may also include additional optional elements,e.g. a memory port 103, a bridge 170, one or more input/output devices130 a-130 n (generally referred to using reference numeral 130), and acache memory 140 in communication with the central processing unit 121.

The central processing unit 121 is any logic circuitry that responds toand processes instructions fetched from the main memory unit 122. Inmany embodiments, the central processing unit 121 is provided by amicroprocessor unit, e.g.: those manufactured by Intel Corporation ofMountain View, Calif.; those manufactured by Motorola Corporation ofSchaumburg, Ill.; the ARM processor and TEGRA system on a chip (SoC)manufactured by Nvidia of Santa Clara, Calif.; the POWER7 processor,those manufactured by International Business Machines of White Plains,N.Y.; or those manufactured by Advanced Micro Devices of Sunnyvale,Calif. The computing device 100 may be based on any of these processors,or any other processor capable of operating as described herein. Thecentral processing unit 121 may utilize instruction level parallelism,thread level parallelism, different levels of cache, and multi-coreprocessors. A multi-core processor may include two or more processingunits on a single computing component. Examples of a multi-coreprocessors include the AMD PHENOM IIX2, INTEL CORE i5 and INTEL CORE i7.

Main memory unit 122 may include one or more memory chips capable ofstoring data and allowing any storage location to be directly accessedby the microprocessor 121. Main memory unit 122 may be volatile andfaster than storage 128 memory. Main memory units 122 may be Dynamicrandom access memory (DRAM) or any variants, including static randomaccess memory (SRAM), Burst SRAM or SynchBurst SRAM (BSRAM), Fast PageMode DRAM (FPM DRAM), Enhanced DRAM (EDRAM), Extended Data Output RAM(EDO RAM), Extended Data Output DRAM (EDO DRAM), Burst Extended DataOutput DRAM (BEDO DRAM), Single Data Rate Synchronous DRAM (SDR SDRAM),Double Data Rate SDRAM (DDR SDRAM), Direct Rambus DRAM (DRDRAM), orExtreme Data Rate DRAM (XDR DRAM). In some embodiments, the main memory122 or the storage 128 may be non-volatile; e.g., non-volatile readaccess memory (NVRAM), flash memory non-volatile static RAM (nvSRAM),Ferroelectric RAM (FeRAM), Magnetoresistive RAM (MRAM), Phase-changememory (PRAM), conductive-bridging RAM (CBRAM),Silicon-Oxide-Nitride-Oxide-Silicon (SONOS), Resistive RAM (RRAM),Racetrack, Nano-RAM (NRAM), or Millipede memory. The main memory 122 maybe based on any of the above described memory chips, or any otheravailable memory chips capable of operating as described herein. In theembodiment shown in FIG. 1C, the processor 121 communicates with mainmemory 122 via a system bus 150 (described in more detail below). FIG.1D depicts an embodiment of a computing device 100 in which theprocessor communicates directly with main memory 122 via a memory port103. For example, in FIG. 1D the main memory 122 may be DRDRAM.

FIG. 1D depicts an embodiment in which the main processor 121communicates directly with cache memory 140 via a secondary bus,sometimes referred to as a backside bus. In other embodiments, the mainprocessor 121 communicates with cache memory 140 using the system bus150. Cache memory 140 typically has a faster response time than mainmemory 122 and is typically provided by SRAM, BSRAM, or EDRAM. In theembodiment shown in FIG. 1D, the processor 121 communicates with variousI/O devices 130 via a local system bus 150. Various buses may be used toconnect the central processing unit 121 to any of the I/O devices 130,including a PCI bus, a PCI-X bus, or a PCI-Express bus, or a NuBus. Forembodiments in which the I/O device is a video display 124, theprocessor 121 may use an Advanced Graphics Port (AGP) to communicatewith the display 124 or the I/O controller 123 for the display 124. FIG.1D depicts an embodiment of a computer 100 in which the main processor121 communicates directly with I/O device 130 b or other processors 121′via HYPERTRANSPORT, RAPIDIO, or INFINIBAND communications technology.FIG. 1D also depicts an embodiment in which local buses and directcommunication are mixed: the processor 121 communicates with I/O device130 a using a local interconnect bus while communicating with I/O device130 b directly.

A wide variety of I/O devices 130 a-130 n may be present in thecomputing device 100. Input devices may include keyboards, mice,trackpads, trackballs, touchpads, touch mice, multi-touch touchpads andtouch mice, microphones, multi-array microphones, drawing tablets,cameras, single-lens reflex camera (SLR), digital SLR (DSLR), CMOSsensors, accelerometers, infrared optical sensors, pressure sensors,magnetometer sensors, angular rate sensors, depth sensors, proximitysensors, ambient light sensors, gyroscopic sensors, or other sensors.Output devices may include video displays, graphical displays, speakers,headphones, inkjet printers, laser printers, and 3D printers.

Devices 130 a-130 n may include a combination of multiple input oroutput devices, including, e.g., Microsoft KINECT, Nintendo Wiimote forthe WII, Nintendo WII U GAMEPAD, or Apple IPHONE. Some devices 130 a-130n allow gesture recognition inputs through combining some of the inputsand outputs. Some devices 130 a-130 n provides for facial recognitionwhich may be utilized as an input for different purposes includingauthentication and other commands. Some devices 130 a-130 n provides forvoice recognition and inputs, including, e.g., Microsoft KINECT, SIRIfor IPHONE by Apple, Google Now or Google Voice Search.

Additional devices 130 a-130 n have both input and output capabilities,including, e.g., haptic feedback devices, touchscreen displays, ormulti-touch displays. Touchscreen, multi-touch displays, touchpads,touch mice, or other touch sensing devices may use differenttechnologies to sense touch, including, e.g., capacitive, surfacecapacitive, projected capacitive touch (PCT), in-cell capacitive,resistive, infrared, waveguide, dispersive signal touch (DST), in-celloptical, surface acoustic wave (SAW), bending wave touch (BWT), orforce-based sensing technologies. Some multi-touch devices may allow twoor more contact points with the surface, allowing advanced functionalityincluding, e.g., pinch, spread, rotate, scroll, or other gestures. Sometouchscreen devices, including, e.g., Microsoft PIXELSENSE orMulti-Touch Collaboration Wall, may have larger surfaces, such as on atable-top or on a wall, and may also interact with other electronicdevices. Some I/O devices 130 a-130 n, display devices 124 a-124 n orgroup of devices may be augment reality devices. The I/O devices may becontrolled by an I/O controller 123 as shown in FIG. 1C. The I/Ocontroller may control one or more I/O devices, such as, e.g., akeyboard 126 and a pointing device 127, e.g., a mouse or optical pen.Furthermore, an I/O device may also provide storage and/or aninstallation medium 116 for the computing device 100. In still otherembodiments, the computing device 100 may provide USB connections (notshown) to receive handheld USB storage devices. In further embodiments,an I/O device 130 may be a bridge between the system bus 150 and anexternal communication bus, e.g. a USB bus, a SCSI bus, a FireWire bus,an Ethernet bus, a Gigabit Ethernet bus, a Fibre Channel bus, or aThunderbolt bus.

In some embodiments, display devices 124 a-124 n may be connected to I/Ocontroller 123. Display devices may include, e.g., liquid crystaldisplays (LCD), thin film transistor LCD (TFT-LCD), blue phase LCD,electronic papers (e-ink) displays, flexile displays, light emittingdiode displays (LED), digital light processing (DLP) displays, liquidcrystal on silicon (LCOS) displays, organic light-emitting diode (OLED)displays, active-matrix organic light-emitting diode (AMOLED) displays,liquid crystal laser displays, time-multiplexed optical shutter (TMOS)displays, or 3D displays. Examples of 3D displays may use, e.g.stereoscopy, polarization filters, active shutters, or autostereoscopic.Display devices 124 a-124 n may also be a head-mounted display (HMD). Insome embodiments, display devices 124 a-124 n or the corresponding I/Ocontrollers 123 may be controlled through or have hardware support forOPENGL or DIRECTX API or other graphics libraries.

In some embodiments, the computing device 100 may include or connect tomultiple display devices 124 a-124 n, which each may be of the same ordifferent type and/or form. As such, any of the I/O devices 130 a-130 nand/or the I/O controller 123 may include any type and/or form ofsuitable hardware, software, or combination of hardware and software tosupport, enable or provide for the connection and use of multipledisplay devices 124 a-124 n by the computing device 100. For example,the computing device 100 may include any type and/or form of videoadapter, video card, driver, and/or library to interface, communicate,connect or otherwise use the display devices 124 a-124 n. In oneembodiment, a video adapter may include multiple connectors to interfaceto multiple display devices 124 a-124 n. In other embodiments, thecomputing device 100 may include multiple video adapters, with eachvideo adapter connected to one or more of the display devices 124 a-124n. In some embodiments, any portion of the operating system of thecomputing device 100 may be configured for using multiple displays 124a-124 n. In other embodiments, one or more of the display devices 124a-124 n may be provided by one or more other computing devices 100 a or100 b connected to the computing device 100, via the network 104. Insome embodiments software may be designed and constructed to use anothercomputer's display device as a second display device 124 a for thecomputing device 100. For example, in one embodiment, an Apple iPad mayconnect to a computing device 100 and use the display of the device 100as an additional display screen that may be used as an extended desktop.One ordinarily skilled in the art will recognize and appreciate thevarious ways and embodiments that a computing device 100 may beconfigured to have multiple display devices 124 a-124 n.

Referring again to FIG. 1C, the computing device 100 may comprise astorage device 128 (e.g. one or more hard disk drives or redundantarrays of independent disks) for storing an operating system or otherrelated software, and for storing application software programs such asany program related to the simulated phishing attack system software120. Examples of storage device 128 include, e.g., hard disk drive(HDD); optical drive including CD drive, DVD drive, or BLU-RAY drive;solid-state drive (SSD); USB flash drive; or any other device suitablefor storing data. Some storage devices may include multiple volatile andnon-volatile memories, including, e.g., solid state hybrid drives thatcombine hard disks with solid state cache. Some storage device 128 maybe non-volatile, mutable, or read-only. Some storage device 128 may beinternal and connect to the computing device 100 via a bus 150. Somestorage device 128 may be external and connect to the computing device100 via a I/O device 130 that provides an external bus. Some storagedevice 128 may connect to the computing device 100 via the networkinterface 118 over a network 104, including, e.g., the Remote Disk forMACBOOK AIR by Apple. Some client devices 100 may not require anon-volatile storage device 128 and may be thin clients or zero clients102. Some storage device 128 may also be used as an installation device116 and may be suitable for installing software and programs.Additionally, the operating system and the software can be run from abootable medium, for example, a bootable CD, e.g. KNOPPIX, a bootable CDfor GNU/Linux that is available as a GNU/Linux distribution fromknoppix.net.

Client device 100 may also install software or application from anapplication distribution platform. Examples of application distributionplatforms include the App Store for iOS provided by Apple, Inc., the MacApp Store provided by Apple, Inc., GOOGLE PLAY for Android OS providedby Google Inc., Chrome Webstore for CHROME OS provided by Google Inc.,and Amazon Appstore for Android OS and KINDLE FIRE provided byAmazon.com, Inc. An application distribution platform may facilitateinstallation of software on a client device 102. An applicationdistribution platform may include a repository of applications on aserver 106 or a cloud 108, which the clients 102 a-102 n may access overa network 104. An application distribution platform may includeapplication developed and provided by various developers. A user of aclient device 102 may select, purchase and/or download an applicationvia the application distribution platform.

Furthermore, the computing device 100 may include a network interface118 to interface to the network 104 through a variety of connectionsincluding, but not limited to, standard telephone lines LAN or WAN links(e.g., 802.11, T1, T3, Gigabit Ethernet, Infiniband), broadbandconnections (e.g., ISDN, Frame Relay, ATM, Gigabit Ethernet,Ethernet-over-SONET, ADSL, VDSL, BPON, GPON, fiber optical includingFiOS), wireless connections, or some combination of any or all of theabove. Connections can be established using a variety of communicationprotocols (e.g., TCP/IP, Ethernet, ARCNET, SONET, SDH, Fiber DistributedData Interface (FDDI), IEEE 802.11a/b/g/n/ac CDMA, GSM, WiMax and directasynchronous connections). In one embodiment, the computing device 100communicates with other computing devices 100′ via any type and/or formof gateway or tunneling protocol e.g. Secure Socket Layer (SSL) orTransport Layer Security (TLS), or the Citrix Gateway Protocolmanufactured by Citrix Systems, Inc. of Ft. Lauderdale, Fla. The networkinterface 118 may comprise a built-in network adapter, network interfacecard, PCMCIA network card, EXPRESSCARD network card, card bus networkadapter, wireless network adapter, USB network adapter, modem or anyother device suitable for interfacing the computing device 100 to anytype of network capable of communication and performing the operationsdescribed herein.

A computing device 100 of the sort depicted in FIGS. 1B and 1C mayoperate under the control of an operating system, which controlsscheduling of tasks and access to system resources. The computing device100 can be running any operating system such as any of the versions ofthe MICROSOFT WINDOWS operating systems, the different releases of theUnix and Linux operating systems, any version of the MAC OS forMacintosh computers, any embedded operating system, any real-timeoperating system, any open source operating system, any proprietaryoperating system, any operating systems for mobile computing devices, orany other operating system capable of running on the computing deviceand performing the operations described herein. Typical operatingsystems include, but are not limited to: WINDOWS 2000, WINDOWS Server2012, WINDOWS CE, WINDOWS Phone, WINDOWS XP, WINDOWS VISTA, and WINDOWS7, WINDOWS RT, and WINDOWS 8 all of which are manufactured by MicrosoftCorporation of Redmond, Wash.; MAC OS and iOS, manufactured by Apple,Inc. of Cupertino, Calif.; and Linux, a freely-available operatingsystem, e.g. Linux Mint distribution (“distro”) or Ubuntu, distributedby Canonical Ltd. of London, United Kingom; or Unix or other Unix-likederivative operating systems; and Android, designed by Google, ofMountain View, Calif., among others. Some operating systems, including,e.g., the CHROME OS by Google, may be used on zero clients or thinclients, including, e.g., CHROMEBOOKS.

The computer system 100 can be any workstation, telephone, desktopcomputer, laptop or notebook computer, netbook, ULTRABOOK, tablet,server, handheld computer, mobile telephone, smartphone or otherportable telecommunications device, media playing device, a gamingsystem, mobile computing device, or any other type and/or form ofcomputing, telecommunications or media device that is capable ofcommunication. The computer system 100 has sufficient processor powerand memory capacity to perform the operations described herein. In someembodiments, the computing device 100 may have different processors,operating systems, and input devices consistent with the device. TheSamsung GALAXY smartphones, e.g., operate under the control of Androidoperating system developed by Google, Inc. GALAXY smartphones receiveinput via a touch interface.

In some embodiments, the computing device 100 is a gaming system. Forexample, the computer system 100 may comprise a PLAYSTATION 3, orPERSONAL PLAYSTATION PORTABLE (PSP), or a PLAYSTATION VITA devicemanufactured by the Sony Corporation of Tokyo, Japan, a NINTENDO DS,NINTENDO 3DS, NINTENDO WII, or a NINTENDO WII U device manufactured byNintendo Co., Ltd., of Kyoto, Japan, an XBOX 360 device manufactured bythe Microsoft Corporation of Redmond, Wash.

In some embodiments, the computing device 100 is a digital audio playersuch as the Apple IPOD, IPOD Touch, and IPOD NANO lines of devices,manufactured by Apple Computer of Cupertino, Calif. Some digital audioplayers may have other functionality, including, e.g., a gaming systemor any functionality made available by an application from a digitalapplication distribution platform. For example, the IPOD Touch mayaccess the Apple App Store. In some embodiments, the computing device100 is a portable media player or digital audio player supporting fileformats including, but not limited to, MP3, WAV, M4A/AAC, WMA ProtectedAAC, AIFF, Audible audiobook, Apple Lossless audio file formats and.mov, .m4v, and .mp4 MPEG-4 (H.264/MPEG-4 AVC) video file formats.

In some embodiments, the computing device 100 is a tablet e.g. the IPADline of devices by Apple; GALAXY TAB family of devices by Samsung; orKINDLE FIRE, by Amazon.com, Inc. of Seattle, Wash. In other embodiments,the computing device 100 is an eBook reader, e.g. the KINDLE family ofdevices by Amazon.com, or NOOK family of devices by Barnes & Noble, Inc.of New York City, N.Y.

In some embodiments, the communications device 102 includes acombination of devices, e.g. a smartphone combined with a digital audioplayer or portable media player. For example, one of these embodimentsis a smartphone, e.g. the IPHONE family of smartphones manufactured byApple, Inc.; a Samsung GALAXY family of smartphones manufactured bySamsung, Inc; or a Motorola DROID family of smartphones. In yet anotherembodiment, the communications device 102 is a laptop or desktopcomputer equipped with a web browser and a microphone and speakersystem, e.g. a telephony headset. In these embodiments, thecommunications devices 102 are web-enabled and can receive and initiatephone calls. In some embodiments, a laptop or desktop computer is alsoequipped with a webcam or other video capture device that enables videochat and video call.

In some embodiments, the status of one or more machines 102, 106 in thenetwork 104 is monitored, generally as part of network management. Inone of these embodiments, the status of a machine may include anidentification of load information (e.g., the number of processes on themachine, CPU and memory utilization), of port information (e.g., thenumber of available communication ports and the port addresses), or ofsession status (e.g., the duration and type of processes, and whether aprocess is active or idle). In another of these embodiments, thisinformation may be identified by a plurality of metrics, and theplurality of metrics can be applied at least in part towards decisionsin load distribution, network traffic management, and network failurerecovery as well as any aspects of operations of the present solutiondescribed herein. Aspects of the operating environments and componentsdescribed above will become apparent in the context of the systems andmethods disclosed herein.

B. Systems and Methods of Adding Users to User Groups Based onInteractions with Simulated Phishing Attacks and Remediation Training.

This disclosure generally relates to systems and methods for using smartuser groups, also known as dynamic groups, in computer-based securityawareness training systems. Other systems and methods of adding user touser groups may be based on interactions with simulated phishing attacksand remediation training, as are described in this Section B. Thesystems and methods allow a server to automatically add a user of afirst user group to a second user group responsive to that userinteracting with a simulated phishing email that was sent as part of asimulated phishing campaign. In some embodiments, users in a user groupare removed when the users are added to another user group. For example,the user added to the second user group is removed from the first usergroup. The systems and methods further allow the server toelectronically track the remediation training completed by that user,and responsive to the completion of remediation training, the server mayautomatically add the user, who is a member of the second user group,back to the first user group (for embodiments where the user was removedfrom the first user group) or to a third user group. The systems andmethods further allow the server to automatically add the user to one ormore user groups upon detecting an event in connection with the user.

In some embodiments, users remain members of a user group when the usersare added to another user group. For example, the user remains a memberof the first user group when the user is added to the second user group.In another example, the user remains a member of the second user groupwhen the user is added back to the first user group or to the third usergroup.

A simulated phishing attack may test the readiness of a security systemor users of a system to handle phishing attacks such that maliciousactions are prevented. A simulated phishing attack may, for example,target a large number of users, such as employees of an organization.Such an attack may be performed by a party friendly or neutral to thetargets of the simulated attack. In one type of simulated phishingattack, an attempt is made to extract sensitive information usingphishing methods, and any extracted information is used not formalicious purposes, but as part of a process of detecting weaknesses insecurity. Performing a simulated phishing attack can help expose a lackof vigilance and/or know-how in a user or set of users of a device inminimizing risk associated with such attacks. User know-how can beimproved by providing targeted, real-time training to the user at thetime of failing a test provided by a simulated phishing attack.

A method of adding users to user groups is as follows. A systemadministrator, who could be a security manager or a third party onbehalf of a security manager, configures a phishing email template whichis used to generate simulated phishing emails that can masquerade as anemail from a party known to the user, such as an executive of thecompany that employs the user. The email may be designed to appearinteresting to the user, and may offer or promise, for example, accessto an interesting tidbit of news, access to useful computer software,access to knowledge of how to perform a money-making scheme, or anyother thing that may be of interest. In some embodiments, the email mayrequest that the user perform a certain action, such as providingsensitive information by replying to the email or transferring money toan account owned by the attacker and then sending a reply email toconfirm that the money has been transferred. A simulated phishingcampaign is created by a simulated phishing campaign manager inaccordance with selections made by the system administrator or anotherindividual. A system administrator selects a first user group whichcontains the users that will be a part of the simulated phishingcampaign. The system administrator selects a second user group for whichto add those users that interact with a simulated phishing email that isconfigured to be part of the simulated phishing campaign, wherein thesecond user group is selected to receive electronically trackedremediation training. The system receives the selection of the first andsecond user groups.

The system transmits one or more simulated phishing emails, according tothe created simulated phishing campaign, to the users in the first usergroup. The server receives a first indication if a user of the firstuser group interacts with a simulated phishing email of the simulatedphishing campaign. Responsive to receiving the first indication, theserver automatically adds the user, who is a member of the first usergroup, to the second user group. One example of a user interaction witha simulated phishing email is the user sending a reply to or forwardingthe received email. Another example of a user interaction with asimulated phishing email is the user clicking on a link in the receivedemail. In some embodiments, the server tracks the number of times theuser interacts with simulated phishing emails and adds the userresponsive to the number of times reaching a predetermined threshold. Insome embodiments, the server receives an indication of a detection of anevent in connection with a user, who is a member of the first usergroup, and responsive to receiving the indication, adds the user to asecond user group.

Once a user of a first user group is automatically added to the seconduser group, responsive to interacting with a simulated phishing emailfrom the simulated phishing campaign, the user will begin to receiveelectronically tracked remediation training. When the user completes theremediation training, the server receives a second indication. Inresponse to the second indication, the server automatically adds theuser back to the first user group (for embodiments where the user wasremoved from the first user group) or to a third user group. In someembodiments, the server tracks the number of courses of theelectronically tracked remediation training the user has completed. Insome embodiments, the server automatically adds the user, who is amember of the second user group, to a predetermined user groupcorresponding to one or more courses of the number of courses the userhas completed. In some embodiments, the server automatically adds theuser, who is a member of the second user group, back to the first usergroup (for embodiments where the user was removed from the first usergroup) or to a third user group responsive to the number of courses ofelectronically tracked remediation training reaching a given threshold.In further embodiments, the user may be removed from the second usergroup when the user is added the predetermined user group or when theuser is added back to the first user group or to the third user group.

Referring to FIG. 2A in a general overview, FIG. 2A depicts some of thearchitecture of an implementation of a system 200 capable of addingusers to user groups in response to events. The system 200 is alsocapable of removing users from user groups in response to events.

Referring to FIG. 2A in more detail system 200 includes a server 106.The server 106 includes a user group management function 212 whichinteracts with a simulated phishing campaign manager 250, which isresponsible for executing the simulated phishing campaign. The server106 further includes an event tracker 234, a phishing email interactiontracker 235, a remediation training tracker 236, and a user groupselector 238. The user group management function 212 includes a usergroup management application 214, a phishing email user interactioncounter 216, and a user remediation training completion counter 218. Theserver 106 includes several storage modules. Remediation training isstored in storage 240. Users are stored in storage 241. User groups arestored in storage 242, and simulated phishing emails are stored instorage 244.

Each of the server 106, user group management function 212, user groupmanagement application 214, phishing email user interaction counter 216,user remediation training completion counter 218, event tracker 234,phishing email interaction tracker 235, remediation training tracker236, user group selector 238, simulated phishing campaign manager 250,user interface manager 252, and simulated phishing email generator 254may comprise a program, service, task, script, library, application orany type and form of executable instructions or code executable on oneor more processors. Any of the server 106, user group managementfunction 212, user group management application 214, phishing email userinteraction counter 216, user remediation training completion counter218, event tracker 234, phishing email interaction tracker 235,remediation training tracker 236, user group selector 238, simulatedphishing campaign manager 250, user interface manager 252, simulatedphishing email generator 254, messaging application 270 and/orcommunications module 264 may be combined into one or more modules,applications, programs, services, tasks, scripts, libraries,applications, or executable code.

The simulated phishing campaign manager 250 includes a simulatedphishing email generator 254, which may be implemented as or contain avirtual machine 256. Responsive to a user input, the simulated phishingcampaign manager 250 generates a campaign for a simulated phishingattack, including one or more selected phishing email templates, one ormore selected landing page templates, and one or more selected targeteduser groups, in addition to other user input.

In an implementation, system 200 includes a server 106. The server 106may be a part of a cluster of servers. In some embodiments, tasksperformed by the server 106 may be performed by a plurality of servers.These tasks may be allocated among the cluster of servers by anapplication, service, daemon, routine, or other executable logic fortask allocation. The server 106 may include a processor and memory.

In an implementation, system 200 includes a client 102. In someembodiments, the client may include a communications module 264, a userinterface 266, a display 268, and a messaging application 270. Theclient 102 may interact with the server 106 over a network, 104.

In some embodiments, the server 106 includes a simulated phishingcampaign manager 250 which may manage various aspects of a simulatedphishing attack campaign. For example, the simulated phishing campaignmanager 250 may process input from the server 106 and/or may provideaccess as needed to various applications, modules, and other softwarecomponents of the server 106 to other various applications, modules, andother software components of the server 106. The simulated phishingcampaign manager 250 may monitor and control timing of various aspectsof a simulated attack campaign, may process requests for access tosimulated attack campaign results, and/or may perform other tasksrelated to the management of a simulated attack campaign.

In some embodiments, the simulated phishing campaign module 250 may beintegrated with or coupled to memory 122. In some embodiments, thememory may include any type and form of storage, such as a database orfile system. The memory 122 may store data such as parameters andscripts associated with a particular simulated phishing campaign. In anexample, the memory 122 may store a set of parameters and scriptscorresponding to the choices made by a server 106 through a simulatedphishing campaign manager 250, e.g. as described above for a particularsimulated phishing attack.

In an implementation, the simulated phishing campaign manager 250includes a simulated phishing email generator 254. The simulatedphishing email generator 254 may be integrated with or coupled to thememory 122 so as to provide the simulated phishing email generator 254accesses to parameters associated with messaging choices made for aparticular simulated campaign by e.g. the server 106. The simulatedphishing email generator 254 may be integrated with or coupled to memoryor a memory store or otherwise a storage, such as a database, containingfailure remediation training 240. The simulated phishing email generator254 may be integrated with or coupled to memory or a memory store orotherwise a storage, such as a database, containing users 241. Thesimulated phishing email generator 254 may be integrated with or coupledto memory or a memory store or otherwise a storage, such as a database,containing user groups 242. The simulated phishing email generator 254may be integrated with or coupled to memory or a memory store orotherwise a storage, such as a database, containing simulated phishingemails 244. The simulated phishing email generator 254 may be anapplication, service, daemon, routine, or other executable logic forgenerating messages. The messages generated by the simulated phishingemail generator 254 may be of any appropriate format. For example, theymay be email messages, text messages, messages used by particularmessaging applications such as, e.g., WhatsApp™, or any other type ofmessage. Message type to be used in a particular attack may be selectedby e.g. a server 106 using a simulated phishing campaign manager 250.The messages may be generated in any appropriate manner, e.g. by runningan instance of an application that generates the desired message type,such as running e.g. a Gmail™ application, Microsoft Outlook™,WhatsApp™, a text messaging application, or any other appropriateapplication. The messages may be generated by running a messagingapplication on e.g. a virtual machine 256 or may simply be run on anoperating system of the server 206, or may be run in any otherappropriate environment. The messages may be generated to be formattedconsistent with specific messaging platforms, for example Outlook 365,Outlook Web Access (OWA), Webmail, iOS, Gmail client, and so on.

In some embodiments, the simulated phishing email generator 254 can beconfigured to generate messages having the ability to traverse users whointeract with the messages to a specific landing page.

In some embodiments, the simulated phishing email generator 254 can beconfigured to generate a simulated phishing email. The email can appearto be delivered from a trusted email address, such as the email addressof an executive of the company at which the target is employed. Inaddition, the email can have a “Subject:” field that is intended tocause the user to take an action, such as initiating a wire transfer. Insome embodiments, the simulated phishing email generator 254 cangenerate one or more simulated phishing emails which are stored in thesimulated phishing emails storage 244. In some embodiments, thesimulated phishing email generator 254 can generate multiple instancesof the email which may be delivered to multiple users selected from theusers storage 241, such as a subset of all of the employees of thecompany. In some embodiments, the simulated phishing email generator 254can generate multiple instances of the email which may be delivered to auser group which is stored in the user groups storage 242. For example,the server 106 can select any number of employees who should be targetedby a simulated attack, can create a user group and store this user groupin the user groups storage 242. The simulated phishing email generator254 can retrieve this information from the user groups storage 242 andcan generate a set of emails similar to the email, each addressed to arespective target identified in the information stored in the memory122. That is, the simulated phishing email generator 254 can generatethe emails such that the “From:” and “Subject:” fields of each email areidentical, while the “To:” field is adjusted according to the desiredtargets.

The event tracker 234 detects and keeps track of events in connectionwith users associated with simulated phishing campaigns. An event may beany type of activity, interaction, behavior, notification, alert orcommunication that may occur by or in association with a user and/or asimulated phishing campaign. In one embodiment, an event comprises anumber of times a user interacts with a simulated phishing email. Inanother embodiment, an event comprises a number of courses of theelectronically tracked remediation training the user has completed sincea last time the user interacted with a simulated phishing email. In oneembodiment, an event comprises a number of simulated phishing campaignsrun since a last time the user interacted with a simulated phishingemail. In one embodiment, an event comprises the amount of time sincethe last time the user interacted with a simulated phishing email. Inone embodiment, an event comprises the amount of time since the lasttime the user completed a course of the electronically trackedremediation training.

The user group management function 212 comprises a user group managementapplication 214 that generally manages the adding of a user to a usergroup. For some embodiments, the user group management application 214also manages the removal of a user from a user group. In one embodiment,the user group management application 214 manages the adding of a userof one user group to another user group responsive to a user interactingwith a simulated phishing email. In a further embodiment, the user groupmanagement application 214 also manages the removing of the user fromthe one user group when the user is added to the other user groupresponsive to the user interacting with the simulated phishing email. Inone embodiment, the user group management application 214 manages theadding of a user of one user group to another user group responsive to auser completing electronically tracked remediation training. In afurther embodiment, the user group management application 214 alsomanages the removing of the same user from the one user group when theuser is added to another user group responsive to the user completingelectronically tracked remediation training. In one embodiment, the usergroup management application 214 manages the adding of a user of oneuser group to another user group responsive to an event related to thesimulated phishing campaign. In a further embodiment, the user groupmanagement application 214 also manages the removing of the same userfrom the one user group when the user is added to another user groupresponsive to the event related to the simulated phishing campaign.

The user group management function 212 also comprises a phishing emailuser interaction counter 216 that counts, tracks, and/or manages anumber of interactions of users with simulated phishing emails. In oneembodiment, the phishing email user interaction counter 216 keeps trackof how many times a given user interacts with a given simulated phishingemail. In one embodiment, the phishing email user interaction counter216 keeps track of how many times a given user interacts with anysimulated phishing email. In one embodiment, the phishing email userinteraction counter 216 keeps track of the amount of time betweeninstances when a given user interacts with a specific simulated phishingemail, or with any simulated phishing email. In one embodiment, thephishing email user interaction counter 216 keeps track of how manytimes users in a given user group interact with a specific simulatedphishing email. In one embodiment, the phishing email user interactioncounter 216 keeps track of the way and the number of times in which agiven user interacts with a simulated phishing email, for example, thenumber of times that a given user clicks on a link in a simulatedphishing email, or the number of times that a given user replies orforwards a simulated phishing email.

The phishing email interaction tracker 235 detects and keeps track ofuser interactions with simulated phishing emails by using the phishingemail user interaction counter 216. In some embodiments, the phishingemail interaction tracker 235 receives indications from the phishingemail user interaction counter 216 any time a user interacts with asimulated phishing email. For example, the phishing email interactiontracker 235 uses the phishing email user interaction counter 216 to keeptrack of the user interactions which may be counted and stored in adatabase. In one embodiment, the phishing email interaction tracker 235detects and keeps track of when the user clicks a link in a simulatedphishing email. In one embodiment, the phishing email interactiontracker 235 detects and keeps track of when the user replies to asimulated phishing email. In one embodiment, the phishing emailinteraction tracker 235 detects and keeps track of when the userforwards a simulated phishing email.

The user group management function 212 also comprises a user remediationtraining completion counter 218 that counts, tracks, and/or manages thetaking and completion of remediation training and courses. In oneembodiment, the user remediation training completion counter 218 keepstrack of the number of courses of electronically tracked userremediation training a user has completed. In one embodiment, the userremediation training completion counter 218 keeps track of whether auser has completed specific user remediation training. In oneembodiment, the user remediation training completion counter 218 keepstrack of whether the user has completed a minimum or specific subset ofthe electronically tracked remediation training. In one embodiment, theuser remediation training completion counter 218 keeps track of theduration of time that the user spends on electronically trackedremediation training. In one embodiment, the user remediation trainingcompletion counter 218 keeps track of the total amount of time elapseduntil the user has completed the electronically tracked remediationtraining.

The remediation training tracker 236 detects and keeps track of anyelectronically tracked remediation training that is assigned to a userby using the user remediation training completion counter 218. In someembodiments, the remediation training tracker 236 receives indicationsfrom the user remediation training completion counter 218 when a userhas completed remediation training. For example, the remediationtraining tracker 236 uses the user remediation training completioncounter 218 to keep track of any electronically tracked remediationtraining that is assigned to the user which may be counted and stored ina database. In one embodiment, the remediation training tracker 236keeps track of one or more courses that comprise the electronicallytracked remediation training. In one embodiment, the remediationtraining tracker 236 keeps track of one or more live, or in person,training that is assigned to a user. In one embodiment, the remediationtraining tracker 236 keeps track of mandatory training and non-mandatorytraining. In one embodiment, the remediation training tracker 236 keepstrack of the amount of time that the user spends completing remediationtraining. In one embodiment, the remediation training tracker 236 keepstrack of how many courses of the electronically tracked remediationtraining the user completes in a given time period.

The user group selector 238 selects a user group for a simulatedphishing campaign. Each user group may include a list or collection ofone or more users identified by a user name or user identifier. The usergroup select may select a user group to which to add a user and for someembodiments, delete or remove a user based on the user's interactionswith a simulated phishing campaign, training, events., etc. For example,the user group selector 238 can use a processor to select a group in oneor more storage modules (e.g., users storage 241 and user groups storage242) in which to add and for some embodiments, delete or remove the userwithin the one more storage modules. In one embodiment, the user groupselector 238 selects a user group to add users to if they interact witha simulated phishing email. In one embodiment, the user group selector238 selects a user group to add users to if they interacted with asimulated phishing email and then subsequently completed theelectronically tracked remediation training. In one embodiment, thesimulated phishing campaign manager utilizes the user group selector 238to select predetermined groups to add users to in response to specificevents.

In an implementation, a simulated phishing campaign manager 250 may bee.g., another name for a system administrator, such as a securitymanager, a third-party security consultant, a risk assessor, or anyother party that uses the simulated phishing campaign manager 250installed on a server. The server 106 may wish to direct a simulatedphishing attack by interacting with the simulated phishing campaignmanager 250 installed on the server. The simulated phishing campaignmanager 212 may be, for example, a desktop computer, a laptop computer,a mobile device, or any other suitable computing device. The simulatedphishing campaign manager 250 may be e.g., an application on a devicethat allows for a user of the device to interact with the server 106 fore.g. purposes of creating, configuring, tailoring and/or executing asimulated phishing attack and/or viewing and/or processing and/oranalyzing the results of a phishing attack.

In an implementation, the simulated phishing campaign manager 250, whenexecuted, causes a graphical user interface to be displayed to theserver 106. In other embodiments, the simulated phishing campaignmanager 250 allows for user input through a non-graphical userinterface, such as a user interface that accepts text or vocal inputwithout displaying an interactive image. A graphical user interface maybe displayed on a screen of a mobile phone, or a monitor connected to adesktop or laptop computer or may be displayed on any other display. Theuser may interact with e.g. the graphical user interface on the deviceby typing, clicking a mouse, tapping, speaking, or any other method ofinteracting with a user interface. The graphical user interface on thedevice may be a web-based user interface provided by a web browser (e.g.GOOGLE CHROME, Microsoft INTERNET EXPLORER, or Mozilla Firefox providedby Mozilla Foundation of Mountain View, Calif.), or may be anapplication installed on a user device capable of opening a networkconnection to simulated phishing campaign manager 250 or may be anyother type of interface.

In an implementation, the simulated phishing campaign manager 250 and/orserver 106 may make choices concerning how a simulated phishing attackis to be carried out. For example, a graphical user interface run by thesimulated phishing campaign manager 250 may be displayed to the server106. A user via the server 106 may input parameters for the attack thataffect how it will be carried out. For example, via the server 106 auser may make choices as to which users to include as potential targetsin the attack, the method of determining which users are to be selectedas targets of the attack, the timing of various aspects of the attack,whether to use an attack template that includes values for one or aplurality of failure indicators, how responses from targeted usersshould be uniquely identified, and other choices. These choices may bemade by selecting options displayed on a graphical user interface fromdropdown menus, being presented with choices through a simulated attackwizard, or in any other appropriate manner.

In an implementation, the simulated phishing campaign manager 250 mayallow the server 106, such as via application programming interfaces(APIs), to access and/or change settings of an account maintained withany party involved with the attack, such as, for example, a third partysecurity service provider, or may allow the user group managementfunction 212 to access and/or change settings of an account maintainedwith a third party security service provider, such as one that e.g.manages an exploit server, view bills and/or make payments to a thirdparty security service provider, to perform these functions with otherthird parties involved in the attack, or provide any other functionsthat would be appropriate for facilitating communications between theserver 106 and any other parties involved in the attack.

The system 200 includes also the client 102. A client may be a target ofany simulated phishing attack. For example, the client may be anemployee, member, or independent contractor working for an organizationthat is performing a security checkup or conducts ongoing simulatedphishing attacks to maintain security. The client 102 may be any deviceused by the client. The client need not own the device for it to beconsidered a client device 102. The client 102 may be any computingdevice, such as a desktop computer, a laptop, a mobile device, or anyother computing device. In some embodiments, the client 102 may be aserver or set of servers accessed by the client. For example, the clientmay be the employee or a member of an organization. The client mayaccess a server that is e.g. owned or managed or otherwise associatedwith the organization. Such a server may be a client 102.

In some embodiments, the client 102 may further include a user interface266 such as a keyboard, a mouse, a touch screen, or any otherappropriate user interface. This may be a user interface that is e.g.connected directly to a client 102, such as, for example, a keyboardconnected to a mobile device, or may be connected indirectly to a client102, such as, for example, a user interface of a client device used toaccess a server client 102. The client 102 may include a display 268,such as a screen, a monitor connected to the device in any manner, orany other appropriate display.

In an implementation, the client 102 may include a messaging application270. The messaging application 270 may be any application capable ofviewing, editing, and/or sending messages. For example, the messagingapplication 270 may be an instance of an application that allows viewingof a desired message type, such as any web browser, a Gmail™application, Microsoft Outlook™, WhatsApp™, a text messagingapplication, or any other appropriate application. In some embodiments,the messaging application 270 can be configured to display simulatedphishing attack emails. Furthermore, the messaging application 270 canbe configured to allow the target to generate reply messages orforwarded messages in response to the messages displayed by themessaging application 270.

In some embodiments, the client 102 may include a communications module264. This may be a library, application programming interface (API), setof scripts, or any other code that may facilitate communications betweenthe client 102 and any of the server 106, a third-party server, or anyother server. In some embodiments, the communications module 264determines when to transmit information from the client 102 to externalservers via a network 104. In some embodiments, the informationtransmitted by the communications module 264 may correspond to amessage, such as an email, generated by the messaging application 270.

In some embodiments, the server 106 includes a simulated phishingcampaign manager 250. This simulated phishing campaign manager 250analyzes which phishing email templates are most effective in generatinguser failures when the template is used in a simulated phishing attack.The simulated phishing campaign manager 250 additionally determines whatthe most common failure types are for a given template. The simulatedphishing campaign manager 250 may perform additional analysis acrossmany different templates used to determine which failure indicators leadto the highest rate of failures.

For example, the simulated phishing campaign manager 250 may includedata collected from targets, records of failures such as a listing ofwhich targets replied to a simulated phishing email, systemic or othersecurity measures in place during the simulated phishing attacks, timeor date logs, user identifiers, data detailing the results or analysisof attack results including data that indicates associations betweenattack results, and any other appropriate data. The server 106 may view,save, share, print, or perform any other appropriate action with theattack results. The simulated phishing campaign manager 250 may performanalysis on the attack results, possibly upon request of the server 106.For example, this analysis may include determining which users are asecurity risk based on having a number of failures above a predeterminedthreshold, whether certain security systems in place are effective bye.g. correlating the presence of such security systems with a lower thanaverage incidence of failures. The simulated phishing campaign manager250 may allow an attack manager to view, on a graphical user interfacerun by the attack management application 214, such as for example atimeline of overall failure rates, which may be useful in helping todetermine whether a security policy that was instituted at a particulartime was effective in improving security.

In some embodiments, reply emails sent from the client to the server 106can be processed by the simulated phishing campaign manager 250. Forexample, simulated phishing campaign manager 250 can be configured toprocess reply emails received from one or more target clients 260 todetermine the identities of the targets who sent the reply emails. Insome embodiments, the identities of the targets may be determined basedin part on the unique identifiers included within each reply emailreceived by the server 106.

The system 200 may include a network 104. The network 104 may be anytype and/or form of network. The geographical scope of the network 104may vary widely and the network 104 can be a body area network (BAN), apersonal area network (PAN), a local-area network (LAN), e.g. Intranet,a metropolitan area network (MAN), a wide area network (WAN), or theInternet. The topology of the network 104 may be of any form and mayinclude, e.g., any of the following: point-to-point, bus, star, ring,mesh, or tree. The network 104 may be an overlay network which isvirtual and sits on top of one or more layers of other networks 104′.The network 104 may be of any such network topology as known to thoseordinarily skilled in the art capable of supporting the operationsdescribed herein. The network 104 may utilize different techniques andlayers or stacks of protocols, including, e.g., the Ethernet protocol,the internet protocol suite (TCP/IP), the ATM (Asynchronous TransferMode) technique, the SONET (Synchronous Optical Networking) protocol, orthe SDH (Synchronous Digital Hierarchy) protocol. The TCP/IP internetprotocol suite may include application layer, transport layer, internetlayer (including, e.g., IPv6), or the link layer. The network 104 may bea type of a broadcast network, a telecommunications network, a datacommunication network, or a computer network. The network 104 connectsthe server 106 and a client 102. The client 102 comprises acommunications module 264, a user interface 266, a display 268, amessaging application 270, and a memory such as any embodiments ofmemory 122 described herein or any type and form of storage, such as adatabase or file system) The client 102 receives the email sent by theserver 106 based upon the campaign created and executed by the simulatedphishing campaign manager 250. The client 102 is able to receive thesimulated phishing email via the messaging application 270, display thereceived email for the user using the display 268, and is able to acceptuser interaction via the user interface 266 responsive to the displayedemail. If the user interacts with the simulated phishing email, theclient traverses to a landing page used by the simulated phishingcampaign manager 250 in the phishing campaign.

Referring to FIG. 2B in a general overview, FIG. 2B depicts anarchitecture capable of implementing smart groups. In some embodiments,system 200 may include additional architectural elements to providesmart group functionality. In some examples, server 106 includes smartgroup criteria selector 274, smart group criteria tracker 276, smartgroup reporter 280, and smart group management application 271. System200 may include additional storage for smart groups 272 and smart groupcriteria 273. System 200 may also include smart group managementapplication 271.

Referring to FIG. 2B in more detail, system 200 may include smart groupcriteria selector 274 to enable a system or company administrator toselect one or more criteria to be applied to, or associated with, asmart group. Smart group criteria tracker 276 monitors and updates allthe possible criteria that can be applied to, or associated with, asmart group. Smart group reporter 280 is used to create reportspertaining to the members of a smart group. Smart group managementapplication 271 is used to create the membership for the smart group atthe time of an indication that the smart group is to be used for afunction in the computer-based security awareness system. Smart groupsstorage 272 may be used to store the one or more criteria associatedwith a smart group. Smart groups criteria storage 273 may be used tostore all the possible criteria that can be applied to, or associatedwith, a smart group. Membership list are only created when they aregoing to be used, and they are not stored as static group membershiplists are. In some embodiments, historic smart group membership listsmay be archived to enable an administrator to look at changes in thesmart group population. If an administrator wishes to know the currentmembership of a smart group, the administrator can request a list of themembership of the smart group, which will trigger a query based on thesmart group criteria to generate the list that is presented to theadministrator. This makes sure that the membership list is alwayscurrent and not stale. The use of smart groups is not limited tosimulated phishing campaigns, training campaigns, and reportgeneration—smart groups can be used for any purpose where a list ofusers with one or more common attributes is required.

Each of the server 106, user group management function 212, user groupmanagement application 214, phishing email user interaction counter 216,user remediation training completion counter 218, phishing emailinteraction tracker 235, remediation training tracker 236, , simulatedphishing campaign manager 250, user interface manager 252, simulatedphishing email generator 254, smart group criteria selector 274, smartgroup criteria tracker 276, smart group reporter 280 and smart groupmanagement application 271 may comprise a program, service, task,script, library, application or any type and form of executableinstructions or code executable on one or more processors. Any of theserver 106, user group management function 212, user group managementapplication 214, phishing email user interaction counter 216, userremediation training completion counter 218, phishing email interactiontracker 235, remediation training tracker 236, simulated phishingcampaign manager 250, user interface manager 252, simulated phishingemail generator 254, smart group criteria selector 274, smart groupcriteria tracker 276, smart group reporter 280 and smart groupmanagement application 271 may be combined into one or more modules,applications, programs, services, tasks, scripts, libraries,applications, or executable code.

In some embodiments, a system administrator or a company administratormay be able to utilize the smart group management application 271 tocreate one or more smart groups with unique identifiers, such as a name,a number, a handle, or other unique identifier as known in the art. Thesmart group management application 271 may be integrated with or coupledto the memory 122 so as to provide the simulated group managementapplication 271 access to parameters associated with users, user groups,smart groups, smart group criteria, remediation training, and otherparameters associated with computer-based security awareness training.In some embodiments, the server 106 and any of the modules or componentsof server 106 are integrated with or coupled to memory or a memory storeor otherwise a storage, such as a database, of server 106 or of anotherdevice, such as an external server, data source, software, system, etc.,that may contain information about the plurality of users.

The administrator may wish to apply the smart group to the entirepopulation of users, or may wish to apply to smart group to a subset ofthe population of users.

The administrator may also rename an existing smart group, or merge oneor more existing smart groups using the smart group managementapplication 271. In an implementation, smart group criteria selector 274may manage the process by which a company administrator or a systemadministrator selects the criteria to use when identifying users thatbelong to the smart group. Smart group management application 271 andsmart group criteria selector 274 may process input from the server 106and/or may provide access as needed to various applications, modules,and other software components of the server 106 to other variousapplications, modules, and other software components of the server 106.The smart group criteria selector 274 may present a choice of criteriato an administrator using a user interface which may be provided by userinterface manager 252 of simulated phishing campaign manager 250. Forexample, the criteria may be presented as a drop-down menu from whichthe administrator may be able to select one or more criteria for thesmart group. The criteria that are selectable by the administrator arestored in the smart group criteria storage 273. These criteria may beupdated from time to time. The smart group management application 271may be an application, service, daemon, routine, or other executablelogic for generating messages. The messages generated by the smart groupmanagement application may be of any appropriate format.

In some embodiments, smart group management application 271 provides anindicator noting which group is a smart group when shown in a list ofall groups. For example, the smart groups can be listed prior to orafter the “normal” console static groups with a heading for each type ofgroup. The smart group management application 271 includes userinterface that allows administrators to set up or configure the smartgroups. This interface can be a fully graphical user interface thatincludes e.g., drop down boxes (i.e., operators) so you can selectprovided criteria (e.g., “all users that have been phished” or “allusers who were not phished in the last 30 days”). In some examples, theadministrator can enter or modify the date or time period for trackingcriteria. In some embodiments, the administrator can press a plus (+)button and add criteria (e.g., add criteria, then add more criteria,etc.) in order to create the smart group.

Smart group criteria selector 274 enables a system or companyadministrator to select one or more criteria to be applied to, orassociated with, a smart group. The smart group criteria selector 274may be integrated with or coupled to the memory 122 so as to provide thesimulated group management application 271 access to parametersassociated with users, user groups, smart groups, smart group criteria,remediation training, and other parameters associated withcomputer-based security awareness training. In some embodiments, theserver 106 and any of the modules or components of server 106 areintegrated with or coupled to memory or a memory store or otherwise astorage, such as a database, of server 106 or of another device, such asan external server, data source, software, system, etc., that maycontain information about the plurality of users.

An administrator (may be a system administrator or a companyadministrator) may wish to create a smart group at any time, for examplebefore a simulated phishing campaign, before requesting a report, whenthe company active directory has been integrated, when a computer-basedsecurity awareness training program is established, etc. In someembodiments, when creating a smart group, the system 200 saves a namefor the smart group and criteria selected for the smart group using thesmart group criteria selector 274. The name of the smart group and thecriteria for the smart group may be stored in smart groups storage 272.The criteria for the smart group does not change, but the users thatmeet the criteria of the smart group may change over time. The list ofusers for the smart group is therefore only generated when an indicationis received that the smart group is to be used for some purpose.

The smart group criteria selector 274 can be used to change the criteriaof a smart group by an administrator at any time after the smart groupis created. Smart groups may be based on multiple criteria, for example,the system can combine one or more logical operators with multiplecriteria together (e.g., “users who have not been trained” AND “userswho have been phished in the past x months” criteria). In someembodiments, the system 200 may limit the number of criteria that may becombined to form a smart group.

In some embodiments, system 200 includes the ability to nest staticgroups within smart groups. For example, instead of just having criteriawhich determines which users are members of a group because of specificcriteria or attributes, the smart group criteria selector 274 may alsoallow the administrator to select existing static groups and smartgroups, such that the members of the static group or first smart groupare also members of the second smart group. In some examples, the system200 and the smart group criteria selector 274 are also able to selectorganizational or administrative groups, for example all users who are amember of the accounting group. In a nested group situation, the secondand subsequent groups included within the nest may or may not becriteria-based.

In one embodiment, a smart group is created by an administrator before acampaign. The administrator names the smart group (Group A) and choosescriteria for the group, for example “all users that have never beentrained”, or “users who haven't been phished in last 5 months”. Then,the administrator creates a training campaign and directs the system(via a user interface) to use the members of Group A for the trainingcampaign. Before the training campaign starts, the system compiles alist of users that meet the Group A's criteria (e.g., “users who havenever been trained”) at this specific moment in time and then adds theseusers to the training campaign. At this point in time, these added usersare considered members of smart group “Group A”. In this specificexample, the moment that the users have completed training, they wouldno longer be a member of the smart group since the smart groupmembership only includes “users who have never been trained”. Thus, thesmart group's membership is dynamic, and the instantaneous membershipchanges as events take place.

Smart group criteria can consist of any attribute that could beapplicable to a user. Smart group criteria tracker 276 monitors andupdates all the possible criteria that can be applied to, or associatedwith, a smart group. Some examples of smart group criteria include:

-   -   phish prone percentage for user;    -   number of times the user has interacted with a phishing message;    -   number of times the user has interacted with a simulated        phishing message;    -   whether the user has been phished in the last X        days/weeks/months;    -   whether the user has been trained in the last X        days/weeks/months;    -   whether the user has been part of a simulated phishing campaign        in the last X days/weeks/months;    -   Different in user “clicks” tracked before and after training;    -   Number of user “clicks” tracked over a specific time period        (e.g., X days/weeks/months); and    -   Number of user “replies” tracked over a specific time period        (e.g., X days/weeks/months).

Data applied in determining if a user fits smart group criteria may belimited to a specific time period (e.g., XXX days/weeks/months).Examples of smart groups created based on above criteria list caninclude:

-   -   Users with a personal phish prone percentage greater than X        (e.g., “worst 5% clickers”, “worst 10% clickers”);    -   Users that have “clicked” more than X times in the past Y        months;    -   Users that have or have not been phished in X months;    -   Users that have or have not been trained in X months;    -   Users that have or have not “clicked” after finishing training;    -   Users that have “never clicked” or “non-clickers” group (e.g.,        users who have not clicked in X days or Y months or perhaps in        last Z campaigns);    -   Users that have failed via some mode (“click”, data entered,        reply, etc. . . . ) in the past X months; and    -   Users that have “clicked” before training but not after        training.

In some embodiments, smart group reporter 280 is used to create reportspertaining to the members of a smart group. There may be instances wherereporting of smart groups provides no users depending on the smart groupcriteria. For example, assume Group B is a smart group created based onthe following criterion: “users who haven't been phi shed in the last 5months”. At the start of a security awareness program, everyone in theorganization participates in an initial simulated phishing campaign. Ifthe smart group reporter 280 is requested to provide a report of themembers of Group B before this campaign, the report would include allthe users in the organization. After Group B is used for a campaign, ifthe smart group reporter 280 is requested to provide a report of themembers of Group B after this campaign, the report would include nousers in the organization. Smart groups may be created that are onlyused for campaigns or that are only used for reporting. For example,reporting may be focused more on geographic locations and overall healthfor a specific organization, group or location and less concerned aboutgroups being set up in the console. For reporting, companies may want toaggregate or group information by some other criteria that has nothingto do with why they were phished or trained (e.g., check to see if thereare people that have slipped through the cracks, or people that aredoing well, or people that are always failures).

Referring to FIG. 3A in a general overview, FIG. 3A depicts animplementation of a method 300 for adding users to user groups. In abrief overview, the method 300 can include receiving a selection of afirst user group for which to communicate simulated phishing emails of asimulated phishing email campaign (step 310). The method 300 can includereceiving a selection of a second user group for which to add thoseusers that interact with a simulated phishing email of a simulatedphishing email campaign (step 320). The method can include receiving afirst indication that a user of the first user group interacted with asimulated phishing email (step 330). The method can include, responsiveto the first indication, automatically adding the user, who is a memberof the first user group, to the second user group (step 340). The methodcan include receiving a second indication that the user completedremediation training (step 350). The method can include, responsive tothe second indication, adding the user, who is a member of the seconduser group, back to the first user group (for embodiments where the userwas removed from the first user group) or to a third user group (step360).

In some embodiments, the simulated phishing campaign manager 250 mayreceive the selection of the first user group at step 310 and theselection of the second user group at step 320 via any type ofinterface, for example a graphical user interface (GUI), and applicationprogram interface (API), or a command line interface (CLI). Theinterface may be menu driven, or form based, or may be based on naturallanguage processing or may be gesture driven. The first user group maybe an existing user group, or the system administrator may create a newuser group from scratch. The simulated phishing campaign manager 250 mayreceive one user group or may receive more than one user group toreceive the simulated phishing emails of the simulated phishingcampaign. In one embodiment, the simulated phishing campaign manager 250receives a user group by enabling the creation of a custom user group.For example, one user group can be designated as holding or otherwisestoring users selected to receive a simulated phishing email. In anotherexample, a user group can be designated as holding or otherwise storingusers that interacted with a simulated phishing email (e.g., by clickingon a link in the email). In another example, a user group can bedesignated as holding or otherwise storing users that did not interactwith a simulated phishing email (e.g., did not click on a link inemail). Other examples of group designations may be appreciated by oneof skill in the art.

In some embodiments, the simulated phishing campaign manager 250receives a first indication that a user of the first user groupinteracted with a simulated phishing email at step 330 through the useof the phishing email interaction tracker 235 receiving indications fromthe phishing email user interaction counter 216.

In some embodiments, at step 340, responsive to receiving the firstindication that a user of the first user group interacted with asimulated phishing email, the simulated phishing campaign manager 250automatically adds the user, who is a member of the first user group, tothe second user group. The simulated phishing campaign manager 250automatically adds the user to user groups. In some embodiments, thesimulated phishing campaign manager 250 also automatically removes theuser from user groups.

In some embodiments, the simulated phishing campaign manager 250receives a second indication that the user completed remediationtraining at step 350 through the use of the remediation training tracker236 receiving indications from the user remediation training completioncounter 218.

In some embodiments, at step 360, responsive to receiving the secondindication that the user completed remediation training, the simulatedphishing campaign manager 250 automatically adds the user, who is amember of the second user group, back to the first user group (forembodiments where the user was removed from the first user group) and toa third user group. The simulated phishing campaign manager 250automatically adds the user to user groups. In some embodiments, thesimulated phishing campaign manager 250 also automatically removes theuser from user groups.

FIG. 3B depicts one embodiment of an implementation of a method 300 foradding the user to user groups. In a brief overview, the method 300 caninclude receiving a selection of a first user group for which tocommunicate simulated phishing emails of a simulated phishing emailcampaign (step 310). The method 300 can include receiving a selection ofa second user group for which to add those users that interact with asimulated phishing email of a simulated phishing email campaign (step320). The method can include receiving a first indication that a user ofthe first user group interacted with a simulated phishing email (step330). The method can include tracking the number of times the user hasinteracted with simulated phishing emails (step 332). The method caninclude, responsive to the number of times the user has interacted withsimulated phishing emails reaching a predetermined threshold,automatically adding the user, who is a member of the first user group,to the second user group (step 342). The method can include receiving asecond indication that the user completed remediation training (step350). The method can include, responsive to the second indication,adding the user, who is a member of the second user group, back to thefirst user group (for embodiments where the user was removed from thefirst user group) or to a third user group (step 360).

In some embodiments, at step 332, the system tracks the total number oftimes ever that a given user has interacted with a simulated phishingemail. In some embodiments, the system tracks the number of times that agiven user has interacted with a simulated phishing email since thestart of a specific simulated phishing campaign. In one embodiment, thesystem resets the count when the user completes remediation trainingrelated to simulated phishing emails. In one embodiment, the systemadministrator may manually reset the count of the number of times that agiven user has interacted with a simulated phishing email.

In some embodiments, at step 342, the predetermined threshold isspecific to the first user group. In some embodiments, the predeterminedthreshold is specific to a given user. In some embodiments, thethreshold is predetermined at the start of the simulated phishingcampaign. In some embodiments, there is a unique threshold for differenttypes of user interactions with the simulated phishing email. In oneembodiment, there is a unique predetermined threshold for the number oftimes the user interacted with the simulated phishing email by clickingon a link in the email. In one embodiment, there is a unique andpredetermined threshold for the number of times the user interacted withthe simulated phishing email by replying to the simulated phishingemail.

Referring to FIG. 3C in a general overview, FIG. 3C depicts animplementation of a method 300 for adding a user to user groups. In abrief overview, the method 300 can include receiving a selection of afirst user group for which to communicate simulated phishing emails of asimulated phishing email campaign (step 310). The method 300 can includereceiving a selection of a second user group for which to add thoseusers that interact with a simulated phishing email of a simulatedphishing email campaign (step 320). The method can include receiving afirst indication that a user of the first user group interacted with asimulated phishing email (step 330). The method can include, responsiveto the first indication, automatically adding the user, who is a memberof the first user group, to the second user group (step 340). The methodcan include tracking the number of courses of electronically trackedremediation training the user has completed (step 344). The method caninclude receiving a second indication that the user completedremediation training (step 350). The method can include, responsive tothe second indication, automatically adding the user, who is a member ofthe second user group, to a predetermined user group corresponding toone or more courses of the number of courses the user has completed(step 362).

In some embodiments, at step 344, tracking the number of courses ofelectronically tracked remediation training the user has completedthrough the use of the remediation training tracker 236 receivingindications from the user remediation training completion counter 218.

FIG. 3D illustrates an embodiment where added users may be removed fromone user group but added users remain members of a different user group.For example, the method can include, responsive to the secondindication, keeping the user in the second user group while adding theuser to either the first user group (where the user was removed from thefirst user group) or a third user group (step 354). In some embodiments,at step 354, responsive to the second indication, the user remains amember of the second user group while the user is added back to thefirst user group (for embodiments where the user was removed from thefirst user group) or to a third user group through the use of thesimulated phishing campaign manager 250. The simulated phishing campaignmanager 250 adds users to user groups and for some embodiments, removesusers from user groups.

Referring to FIG. 4 in a general overview, FIG. 4 depicts animplementation of a method 400 for creating and using smart groups. In abrief overview, the method 400 can include establishing criteria foridentifying one or more users of a plurality of users (step 400). Themethod 400 can include receiving a selection of at least one criteriafor which to create a group (step 405). The method can includeestablishing a group comprising the at least one criteria (step 410).The method can include, receiving an indication to use the group (step415). The method may include performing a query of the plurality ofusers to determine which one or more users of the plurality of usersmatch the criteria of the group (step 420). The method may also include,responsive to the indication, identifying as members of the group theone or more users identified as a result of the query (step 440).

Referring to FIG. 4 in a more detail, the method 400 can includeestablishing criteria for identifying one or more users of a pluralityof users (step 400). In some embodiments, the security awareness systemadministrator establishes criteria that can be used as a basis foridentifying users. In some examples, a company administrator may definecriteria to be used as a basis for identifying users. The criteriacreated by a company administrator may be proprietary to that company,or may be able to be shared by other companies that use the securityawareness system platform. In some examples, the criteria established bya security awareness system administrator is stored in a smart groupcriteria storage 273. Company specific criteria may be stored in smartgroup criteria storage 273, or may be stored in a different storage onthe server 106, on the client 102, or in the cloud 108.

Method 400 may include receiving a selection of at least one criteriafor which to create a group (step 405). In some embodiments, a companyadministrator may be prompted to set up one or more smart groups priorto creating a simulated phishing campaign, and the system 200 mayreceive the selection of at least one criteria for the smart group as aresponse to the prompt. In some examples, a security awareness programmay be created for a company by the security awareness system, and thesystem 200 receives the one or more criteria to set up one or more smartgroups from the security awareness platform in response to the creationof the company's security awareness program.

Method 400 may include establishing a group comprising at least onecriteria (step 410). In some embodiments, the group is established usingmore than one criteria that are combined by one or more logicaloperators, such as AND, OR, NOT, etc. In some examples, when the groupis established it will be clearly identified as a smart group. The groupmay be additionally classified as a smart group for use in campaigns,and/or a smart group for use in training, and/or smart group for use inreporting. In some embodiments, the system 200 establishes the group byrunning one or more query against a database containing a plurality ofusers and their associated attributes which correspond at least in partto the smart group criteria. In some examples, the system 200 queriesdevices, databases, or other memory storage that is outside of theserver, for example a database hosted by a third party, or a databasehosted by the company.

Method 400 may include receiving an indication to use the group (step415). The indication to use the group may comprise any type ofactivation, trigger, enablement, execution or access of or to the group.The use, activation or execution of the group may be triggered by anytype of event or interaction identifying, referencing. integrating orincorporating the group. For example, access to, identification and/orselection of the group via a user interface may activate or execute thegroup or be a use of the group. For example, access to, identificationand/or selection of the group via an application programming interface(API) may activate or execute the group or be a use of the group. Forexample, referencing the group in a policy and upon triggering thepolicy activates or executes or uses the group. Any time the membershipof the group may be resolved or determined, or be triggered to beresolved or determined, can be an indication to use the request,

In some embodiments, the indication is a request to begin a simulatedphishing campaign including at least users of the smart group. In someexamples, the indication is a request to begin a training campaignincluding at least the users of the smart group. In some examples, theindication may be a request from an administrator for a report includingthe smart group. The indication may be a request from an administratorto compare the current membership of a smart group with a historicalmembership of the same smart group. The indication may be a request froman administrator to compare the current membership of a smart group withthe current membership of another group, which may be a smart group ormay be a static group. The indication may be a request for a membershiplist of the smart group. The indication may be the creation of a reportreferencing the smart group.

Method 400 may include performing a query of the plurality of users todetermine which one or more users of the plurality of users match thecriteria of the group (step 420). In some embodiments, the server mayreceive more than one indication to use the smart group, and uponreceiving each indication, the system will run the query based on thecriteria of the smart group at the time of receiving the indication. Insome examples, method 400 may include adding the one or more users ofthe group identified as a result of the query to an instance ofexecution of a simulated phishing campaign or to a report being created.In some embodiments, the system may perform a query against a databaseof the server 106 or a second device, database or server, on the cloudor in a company's server, where the database contains attributes andinformation about the plurality of users. In some examples, the query ofthe plurality of users to determine which one or more users of theplurality of users match the criteria of the group is done at the timeof use. For example, if the group is going to be used for a simulatedphishing campaign, the query is run at the time when the system needs toperform and action on the users, such as send the users a simulatedphishing message. In some examples, the query is run at a predeterminedtime based on the indication, for example the query may be run at afixed point in time relative to the start of the campaign, even if thelist is used at a later time during the campaign. In some examples, thequery may be run periodically, such that a recent membership list isalways ready to be used in a moment without latency, when an indicationis made. Responsive to the query, the system identifies as members ofthe group the one or more users identified as a result of the query(step 440). In some embodiment, the system associates these users withthe smart group until such time as the query is run again. In someembodiments, the system associates these users with the smart groupuntil the group is used for the function which triggered the indicationto run the query. For example, if the query was triggered due to arequest to run a simulated phishing campaign, the users that areidentified as a result of the query are associated as members of thesmart group until after the simulated phishing campaign has beencompleted. In some embodiments, the system associates the users with thesmart group for a fixed period of time. In some embodiments, the systemassociates the users with the smart group until any other query is runby the system.

It should be understood that the systems described above may providemultiple ones of any or each of those components and these componentsmay be provided on either a standalone machine or, in some embodiments,on multiple machines in a distributed system. The systems and methodsdescribed above may be implemented as a method, apparatus or article ofmanufacture using programming and/or engineering techniques to producesoftware, firmware, hardware, or any combination thereof. In addition,the systems and methods described above may be provided as one or morecomputer-readable programs embodied on or in one or more articles ofmanufacture. The term “article of manufacture” as used herein isintended to encompass code or logic accessible from and embedded in oneor more computer-readable devices, firmware, programmable logic, memorydevices (e.g., EEPROMs, ROMs, PROMs, RAMs, SRAMs, etc.), hardware (e.g.,integrated circuit chip, Field Programmable Gate Array (FPGA),Application Specific Integrated Circuit (ASIC), etc.), electronicdevices, a computer readable non-volatile storage unit (e.g., CD-ROM,floppy disk, hard disk drive, etc.). The article of manufacture may beaccessible from a file server providing access to the computer-readableprograms via a network transmission line, wireless transmission media,signals propagating through space, radio waves, infrared signals, etc.The article of manufacture may be a flash memory card or a magnetictape. The article of manufacture includes hardware logic as well assoftware or programmable code embedded in a computer readable mediumthat is executed by a processor. In general, the computer-readableprograms may be implemented in any programming language, such as LISP,PERL, C, C++, C#, PROLOG, or in any byte code language such as JAVA. Thesoftware programs may be stored on or in one or more articles ofmanufacture as object code.

While various embodiments of the methods and systems have beendescribed, these embodiments are exemplary and in no way limit the scopeof the described methods or systems. Those having skill in the relevantart can effect changes to form and details of the described methods andsystems without departing from the broadest scope of the describedmethods and systems. Thus, the scope of the methods and systemsdescribed herein should not be limited by any of the exemplaryembodiments and should be defined in accordance with the accompanyingclaims and their equivalents.

1-20. (canceled)
 21. A method comprising: receiving, by one or moreservers, criteria for identifying one or more users from a plurality ofusers, establishing, by the one or more servers, a group comprising thecriteria, the group configured to resolve members of the group based onthe one or more users matching the criteria; receiving, by the one ormore servers, an indication to use the group for a simulated phishingcampaign; resolving, by the one or more servers responsive to theindication, the one or more users of the plurality of users that matchthe criteria of the group; executing, by the one or more servers, asimulated phishing campaign using the group; and removing, by the one ormore servers, a user of the one or more users from the group based on aninteraction of the user with the simulated phishing campaign.
 22. Themethod of claim 21, further comprising selecting, by a user groupselector of the server, the group to use for the simulated phishingcampaign.
 23. The method of claim 22, further comprising selecting thegroup from a plurality of groups responsive to an event.
 24. The methodof claim 21, further comprising removing, by the server, one or more ofthe one or more users from the group based at least on the interactionsof the user with training.
 25. The method of claim 21, furthercomprising removing, by the server, one or more of the one or more usersfrom the group based at least on an event associated with the simulatedphishing campaign.
 26. The method of claim 21, further comprisingadding, by the server, a second user from the plurality of users to thegroup based on the second user's interaction to one of a simulatedphishing communication, training or an event.
 27. The method of claim21, further comprising communicating, by the one or more servers, one ormore simulated phishing communications to the one or more users of thegroup.
 28. A system comprising: one or more servers to: receive criteriafor identifying, one or more users from a plurality of users; establisha group comprising the criteria, the group configured to resolve membersof the group based on the one or more users matching the criteria;receive an indication to use the group for a simulated phishingcampaign; resolve, responsive to the indication, the one or more usersof the plurality of users that match the criteria of the group; executea simulated phishing campaign using the group; and remove a user of theone or more users from the group based on an interaction of the userwith the simulated phishing campaign.
 29. The system of claim 28,further comprising a user group selector of at least one of the one ormore servers configured to select the group to use for the simulatedphishing campaign.
 30. The system of claim 29, wherein the user group isfurther configured to select the group from a plurality of groupsresponsive to an event.
 31. The system of claim 28, wherein the one ormore servers are further configured to remove one or more of the one ormore users from the group based at least on the interactions of the userwith training.
 32. The system of claim 28, wherein the one or moreservers are further configured to remove one or more of the one or moreusers from the group based at least on an event associated with thesimulated phishing campaign.
 33. The system of claim 28, wherein the oneor more servers are further configured to add a second user from theplurality of users to the group based on the second user's interactionto one of a simulated phishing communication, training or an event. 34.The system of claim 28, wherein the one or more servers are furtherconfigured to communicate one or more simulated phishing communicationsto the one or more users of the group.
 35. A system comprising: one ormore processors, coupled to memory and configured to: establish a groupconfigured to resolve members of the group based on one or more usersmatching criteria received by the one or more processors; select thegroup for one or more simulated phishing communications; resolve the oneor more users of the plurality of users that match the criteria of thegroup; communicate the one or more simulated phishing communications toone or more devices of the one or more users; and remove a user of theone or more users from the group based on an interaction of the userwith the one or more simulated phi siting communications.
 36. The systemof claim 35, wherein the one or more processors are further configuredto receive the criteria via a user interface.
 37. The system of claim35, wherein the one or more processors are further configured to selectthe group responsive to an indication to use the group for the one ormore simulated phishing communications.
 38. The system of claim 35,wherein the one or more processors are further configured to resolvemembers of the group by performing a query to identify the one or moreusers of the plurality of users that match the criteria.
 39. The systemof claim 35, wherein the one or more processors are further configuredto add a second user from the plurality of users to the group based onthe second user's interaction to one of the one or more simulatedphishing communications, training or an event.
 40. The system of claim35, wherein the one or more processors are further configured to resolvethe members of the group responsive to an indication to use the groupfor the one or more simulated phishing communications.